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ABSTRACT 

This study vas designed to determine the relative 
impact of dichotomized task performance data compared to percent 
time-spent estimates for those members performing each task on the 
group job descriptions determined through application of the 
Comprehensive set of Occupational Data Analysis Programs (CODAP) . 
Using groups identified by a routine application of the CODAP system, 
the percent members performing vector vas found to correlate in the 
mid to high 90* s with the percent time spent by a total group vector 
or group job description. These findings suggest that in groups of 
five or more individuals, dichotomized task perforaance data, which 
has previously been shown to have high reliability and validity, is 
the most critical component in the resultant group job description. 
Further possible time-spent inaccuracies in individual job 
descriptions would not be expected to cause major changes in the 
group job description since its unique contribution accounts for 
effectively less than 10 percent of the total variance. These results 
are consistent across different sized groups of varying homogeneity. 
This report will be of interest only to those agencies engaged in 
occupational data analyses employing the CODAP system. (Author) 
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SENSITIVITY OF GROUP JOB DESCRIPTIONS TO POSSIBLE 
INACCURACIES IN INDIVIDUAL JOB DESCRIPTIONS 



I. INTRODUCTION 

The Comprehensive set of Occupational Data 
Analysis Programs (CODAP) has been under 
continuous development by the Occupational 
Research Division tor more than 10 years (Phalen 
& Christal, 1973). During this period, constant 
methodological development and program re- 
finement has resulted in a highly efficient, if 
complex, series of interrelated computer programs 
designed for analyzing and retrieving occupational 
survey information collected through adminis- 
tration of job-task inventories. The initial rationale 
and supporting research upon which the Air Force 
based its decision to employ the inventory 
approach to obtaining required job or occupa- 
tional data has been comprehensively summarized 
by Morsh , Madden, and Christal (1%1 ) and Morsh 
and Archer (1%7). Numerous studies have been 
conducted and reported which indicate a high 
degree of consistency and reliability in job infor- 
mation collected from incumbents at two points in 
time using task inventories. Recently, Christal 
(1971) reported a high degree of stability in 
consolidated or group job descriptions with split- 
half correlations ranging from .813 to .997 for 
both the "percent members performing** and 
percent time spent" vectors. Reliability of these 
vectors is a basic prerequisite to the successful 
application of the CODAP system. 

II. STATEMENT 01 THE PROBLEM 

One of the major program sequences in the 
CODAP series is designed to determine the existing 
job type groupings in Air Force career ladders. In 
the process of completing the job inventory, each 
job incumbent first checks every listed task which 
he performs in his job and then provides a relative 
time-spent estimate of the comparative amount of 
time spent on each task performed* From this 
information, an individual job description 
specifying the tasks performed and the approx- 
imate percent of total working time spent on each 
task can be easily derived. These task-level job 
descriptions are used as input for an automated 
job clustering program which groups incumbents 
according to the similarity of their jobs using an 
iterative hierarchical grouping process. Archer 
(1966) has presented the program characteristics in 
detail using micro-examples of the computations 
and resultant job type determinations. 



Hie grouping routine may, hence, be assumed 
to employ two elements of information: first, 
dichotomized task performance information or a 
specification of which tasks are performed by each 
incumbent and; second, a comparative 
approximation of the time spent on each of those 
tasks performed by each individual. Intuitively, it 
would be expected that the more specific and 
accurate the information on each job incumbent, 
the better the resultant groupings. However, the 
reliability and more importantly, the validity, may 
be differentially related for these two types of 
information. Prior research has shown that both 
the reliability and validity of task performance 
data arc highly satisfactory. Currently, research is 
directed towards a determination of individual job 
description validity when relative timc-spent data 
is employed. Related to the latter research is the 
question of what might be the differential impact 
of incorporating time-spent estimates containing 
some unquantifiable amount of error as opposed 
to using only dichotomized task performance data 
on the accuracy of the resultant group job descrip- 
tions. This report provides one answer to that 
question. 

III. APPROACH 

A task inventory was recently administered to a 
large segment of the Air Force enlisted population 
performing duty in the Accounting, Finance, and 
Auditing career field (AFS 67XXX). Following a 
standard CODAP job-type grouping analysis, four 
of the identified job clusters were selected for 
further study. Their specific characteristics with 
regard to size and within group homogeneity are 
shown in Table 1 . 

Independently for each of the four selected job 
types, intercorrelation matrices between three 
variables of interest were derived using the task- 
level job descriptions. Variable X is the percent of 
group members performing the task. Variable Y is 
the average percent time spent by only those 
members performing the task. Variable Z is the 
average percent time spent on each task by the 
total job-type group. 

Beginning with one case selected at random 
from each johtype group, the group job descrip- 
tion was derived and a three variable intercorre- 
lation matrix computed. To stabili/.e the variances, 
14 other one<ase samples were randomly selected 
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and similar intcrcorrclation matrices were 
computed for each sample. This procedure was 
repeated for other group si/cs with varying 
numbers of replications. 

IV. RFSULTS 

The group size and number of replications, in 
which each sample was randomly selected from 
the subgroup with replacement, together with the 
average correlations between variables XY, XZ, 
and YZ are shown in Table 2. 

For ease of interpretation, the average corre- 
lations for all groups between dichotomized 
performance data and the CODAP group job 
description is graphically compared with the 
performance by time spent data for those 
members performing and the group job description 
in Figure 1 . 

V. DISCUSSION AND CONCLUSIONS 

For the job-type groups employed in this study, 
differences in si/e, within-group homogeneity, and 
uniqueness of the groups appears to have little if 
any relationship with the differential impact of 
dichotomized task performance data on the group 
job description when compared to the incorpora- 
tion of relative time spent on task data. Because of 
the highly similar pattern of correlations within 
each of the subgroups, overall averages provide the 
simplest and most direct means for interpretation. 

Correlations between percent members per- 
forming and the total group job description 
rapidly stabilize with increases in group size; 
approaching an asymptotic level in the mid to high 
90's when group size exceeds 10 cases. Conversely, 



the correlations between percent time spent by 
members performing and the total group job 
description, while obviously equal to 1.00 when 
n = l, show an initial rapid decrease stabilizing in 
the .60*$ when the group size exceeds 50 cases. 

These findings suggest that group job descrip* 
tions arc relatively impervious to possible minor 
inaccuracies in time-spent on task estimates in 
each individual job description. Operationally, 
when the group of interest exceeds 10 cases, the 
unique contribution of the relative time spent 
estimates is equal to or less than 10% of the total 
variance in the group description. Thus, the group 
job description is effectively based on the appli- 
cation of considerably greater weight to the pure 
task performance information than to the relative 
time-spent values and is a stable estimate of the 
group's actual task level job performance. 

Prior to making any attempt to generalize these 
findings, two further comments are necessary. 
First, the data reported reflect some presently 
unquan tiiiable degree of inaccuracy in the 
individual s .thrived job description. Any change in 
the validity of the individual's task-level job 
description may be expected to change the 
existing relationships. Second, the derived indi- 
vidual time-spent estimates were based on the use 
of a 7-point relative rating of time spent. The use 
of any other scale format would be expected to 
change the resultant job description validity and, 
hence, the reported correlations. While the results 
of this study indicates the current employment of 
the CODAP system yields dependable and valid 
group job descriptions, continued research 
designed to quantify and improve the validity of 
individual job descriptions remains a paramount 
requirement. 



Table /. Characteristics of Selected Job-Type Groupings 



Identification 


A 


8 


c 


0 








Military 


Military 




Accounts 




Pay Ois* 


Pay 


Job* Type 


Control 


Travel 


bursement 


Records 


Composition 


Personnel 


Clerks 


Clerks 


Clerks 


Group Si/e 


no 


103 


90 


208 


Average Overlap 










Within Group 
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Average Overlap 










Between Groups 


13.7 


31.9 
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